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Abstract. The notions of "limiting entropy" and "independence entropy" 
for one-dimensional subshifts were introduced by Louidor, Marcus, and the 
second author in |15) . It was also implicitly conjectured there that these two 
quantities are always equal. We verify this conjecture, which implies, among 
other things, that the limiting entropy of any one-dimensional SFT is of the 
form — logfc for k,n £ N. Our proof also completely characterizes the weak 
limits (as d — > oo) of isotropic measures of maximal entropy; any such measure 
is a Bernoulli extension over some zero entropy factor from an explicitly defined 
set of measures. We also discuss connections of our results to various models 
and results arising in statistical mechanics. 



1. Introduction 

In statistical mechanics, many types of systems are known or believed to exhibit 
mean field behavior in high dimensions. The original context of this term applies to 
the Ising model on Z"^, where the asymptotic behavior in high dimensions resembles 
the Ising model on a complete graph, also known as the "Curie- Weiss model." More 
loosely, the term is used to indicate that in high dimensions the distribution at 
different sites is approximated by independent interactions with a global "mean 
field." The results obtained in this paper are of a related flavor. We state and 
prove them in the framework of symbolic dynamics. Some examples illustrating the 
relevance to statistical mechanics are discussed in Section [S] 

Symbolic dynamics is a branch of dynamics concerned primarily with the study 
of particular Z"* topological dynamical systems called subshifts. A Z"* subshift is 
defined by a finite set S, called an alphabet, and a (possibly infinite) set T of 
functions from S to finite subsets of Z'', which are called configurations. The Z'' 
subshift with alphabet S induced by J^, denoted by X{J'), is defined to be the set 
of infinite configurations in which do not contain any translate of any of the 
forbidden configurations from In the special case where J- is finite, X is called 
a Z"^ shift of finite type, or SFT. 

In this paper we obtain results describing the asymptotic behavior of high- 
dimensional isotropic Z'^-subshifts. The adjective "isotropic" here refers to an ob- 
ject (e.g. subshift, measure) which exhibits the same behavior along each cardinal 
direction. We show that a uniformly chosen large configuration from such a subshift 
exhibits a nearly site-wise independent distribution when conditioned on an explic- 
itly defined "almost-trivial" (T-algebra. The formal statement of this is deferred to 
SectionlU following introduction of terminology and technical definitions in Section 

m 

Given a one-dimensional subshift X = X{J-), the set of possible infinite configu- 
rations in for which words from J- do not occur in any row along any cardinal 
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direction is a d-dimensional subshift, which we call the dth axial power of X and 
denote by X'^'^. For instance, for E {0, 1, 2} and T = {00, 11, 22}, X'^'^ contains 
all {0, 1, 2}-colorings of Z'^ where adjacent sites (sites with distance 1) have distinct 
colors. 

Our main result concerns the limiting topological entropies of Z'' axial powers for 
a fixed one-dimensional subshift, and was implicitly conjectured in jl5j . where key 
definitions and machinery were also developed, including two entropy-like quantities 
associated with any nonempty one-dimensional subshift X. 

The first is called the limiting entropy of X and is denoted hoo{X). The lim- 
iting entropy is defined as a limit of topological entropies for the sequence of d- 
dimensional axial powers of X. The limit here exists since the topological entropies 
of axial powers of X form a nonincreasing sequence; see |15| for details. The lim- 
iting entropy hoo{X) can also be viewed as the topological entropy of a suitably 
defined "infinite-dimensional" axial power, which will form the foundation of our 
proof. 

The second quantity is the independence entropy of X and denoted hindiX). 
Informally, this is a measure of how much of the topological entropy of X comes 
from sitewise independent behavior. If a one-dimensional subshift X has alphabet 
E, then we say that a string A1A2 . . . An of nonempty subsets of E is "independently 
legal for X" if ai . . . a„ appears in a point of X for every choice of ai € ^1 , . . . , a„ S 

An- 

For example, consider the one-dimensional subshift of finite type consisting of 
all X € {0, 1}^ which do not contain consecutive Is, called the golden mean shift 
and denoted by G. Then {0, 1}{0}{0, 1} is independently legal for G, since all 
four words 000, 001, 100, 101 appear in points of G. However, {0, 1}{0, 1}{0} is not 
independently legal for G, since the word 110 is illegal in G. (This is because 110 
contains consecutive Is.) 

Any independently legal string of subsets for a subshift X can be thought of as a 
source of words appearing in points of X which are induced by sitewise independent 
choices. The independence entropy of X is defined as the asymptotic exponential 
growth rate (in n) of the maximum number of words in X so induced by a single 
71-letter independently X-legal string. 

It was shown in [15j that hind{X) < hoaiX) for all subshifts X, and implicitly 
conjectured that the quantities are always equal. Our main result is that this 
conjecture is true. 

Theorem 1.1. For any Z subshift X, hind{X) = hooiX). 

For any SFT X, it was shown in [15] that hind{X) is of the form where 
fc,n G N, and that there is an simple algorithm to compute hind{X). Thus, an 
important consequence of our result is that the limiting entropy for subshifts of 
finite type can be easily computed, and is always a rational multiple of the logarithm 
of a natural number. This is in sharp contrast to the topological entropy of d- 
dimensional subshifts, for which there is no known explicit expression, even for 
some of the simplest nontrivial examples. 

The remainder of the paper is organized as follows. Section [2] contains necessary 
definitions and preliminary results for our arguments and results. Section [3] con- 
tains the proof of Theorem 11.11 Section |4] contains results regarding measures of 
maximal entropy for our infinite-dimensional axial power X , including a uniqueness 
criterion. Section [5] discusses some previously existing results for specific models 
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and how our results fit into this framework, and Section [B] discusses some natural 
questions and directions for future work. 

Acknowledgement: We are grateful to Brian Marcus for his encouragement 
and for many stimulating discussions. We would also like to thank the math de- 
partment of the University of British Columbia and the Pacific institute for Math- 
ematical Sciences for hosting a visit of the second author, when the initial part of 
this research took place. 

2. Definitions and preliminaries 

Many symbolic dynamical concepts and notation are valid for subshifts on any 
countable amenable group G. For our purposes, we will only consider G either 
equal to Z'' for some d S N, or G = Z, which we denote by IP" . 

In other words, Z°° = countable group of infinite sequences of 

integers which have only finitely many non-zero terms. 

Each of these groups is amenable because they admit a F0lner sequence, which 
is a sequence F„ of finite subsets for which , "' — > for all g ^ G. For any 

d e N, [— n, n]'* is a F0lner sequence in , though we will rarely need to refer to 
the amenability of . For the group Z°°, an example of a F0lner sequence is given 
by Fn = [— x {0}°°; unless explicitly stated otherwise, F„ will refer to these 
specific sets. 

For any finite set S, which we call an alphabet^ and any d € NU {c»}, define the 
d- dimensional full shift to be the topological dynamical system given by the space 
, endowed with the shift U^-action {(Jv), defined by {cryx)g := x{g -f v) for all 
w,5 G Z"^ and x € . The full shift is always endowed with the (discrete) product 
topology, with respect to which each shift is a homeomorphism. 

A configuration is defined to be any c € S'^, for a finite set S Q'L'^ . The set S is 
called the shape of the configuration. For any finite set of configurations wi, . . . , Wn 
with disjoint shapes Si, . . . , Sn, their concatenation is the configuration wiW2 ■ ■ ■ Wn 
with shape [J"^i Si defined by {wiW2 ■ ■ ■ Wn)si — '^i for ^ ^i <n. 

A subshift is a closed subset of the Z,'^ full shift which is shift-invariant. Any Z'' 
subshift X can be defined by a (possibly infinite) set of forbidden configurations 
in the following way: 

X = A(J') {x £ E^" : xs+n i T for all finite 5 C Z'' and n G Z^'}. 

When T is finite, we say that X{T^ is a Z'^ subshift of finite type or SFT. For d — 1, 
if J" C we say that X{F) is a k-step SFT. 

For any Z"* subshift X, we define the language of X, written C{X), to be the 
set of all configurations which appear within points of X. For any finite S C 'E'^, 
denote by C{X, S) := C{X) n T,^ the set of configurations in C{X) with shape S. 
For any Z'^ subshift X and w € JC{X, S), the set [w] :— {x £ X : xs = w} is called 
the cylinder set of w. 

Given a Z subshift A C S^, and any d e N, let A®'^ C S^' denote the Z"*- 
subshift defined by 

A®"^ = {x e E^' : Vg e Z'^ e {1, . . . , d}, xg+ze. e X}, 

where Xg+ze; G is the sequence obtained by shifting x hy g and projecting it in 
the ith direction. 
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Similarly, we define X®°° C by 

It is clear that X"^"^ is always a Z'' subshift, since it is closed w.r.t. the product 
topology on , and is invariant with respect to the shift Z''-action on . 

We start with a simple lemma showing that for a fixed d-dimensional shape 5, 
the set of legal configurations with shape S in X'^'^ is the same for any d' > d. 

Lemma 2.1. For any Z subshift X , any d G N, and any finite S C Z'^, C{X^'^,S) = 
C{X®°°,S). 

Proof. The inclusion C(X'^°°, S) C £(X®'^, S) is trivial since the projection x^d is 
clearly in X®'' for any x G It therefore suffices to show the reverse inclusion. 

Consider any w £ C{X^'^,S). By definition, there exists x £ X^''- so that 
ccg = w. We will use x to construct a point of X'^°°. Define x' £ by a;'(.g) := 

oo 

2^(51: 32i • • ■ 1 .9j)- Clearly x'^^ = x, so x'g — w. Also, for any g G Z°° and 

i—d 

i £ N, the row aJ^+^ei ^ '"'-'^ •^5 either in the Xi-direction if i < d or in the 
cccf-direction \i i> d. Since x £ X®'^ , all such rows are in X, and so x' £ We 
have then shown that w £ C{X®°° , S), completing the proof. 

□ 

The topological entropy of a Z"^ subshift X((i£NU{oo})is defined as 
h{X)^ lim J-\og\C{X,Fk)\, 

where Fk is a F0lner sequence for Z*^. 

We define the limiting entropy of a Z subshift X as 

hoo{X) lim h{X®'^). 

The limit exists because h{X®'^) is nonincreasing in d; see (TS] for a proof. 
The next few definitions involve measures on Z'' subshifts (d £ N U {oo}. All 
such measures will be taken to be Borel probability measures with respect to the 
product topology. We say that fi is shift-invariant if cr^/j, = for all v £ Z"*. 
For a shift-invariant measure n on X, the measure-theoretic entropy of /i is 

1 

fc^oo \Fk\ 

where 

H^{Fk):^- j \og^i{[xF^)d^x{x) 

is the Shannon entropy of the discrete random variable x p,, . 

The following fundamental theorem of entropy theory generalizes to any count- 
able amenable group, and beyond. However, our statement deals only with the 
amenable groups X®'^. 

Theorem (Variational principle). For any d £ N U {oo} and subshift X, 

h{X) ~ sup h{fi), 

where the supremum on the right-hand side is over all shift-invariant measures on 
X. 
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hifi) := ,lim —H^iFk), 



For a proof of the variational principle in the general amenable group setting, 
see [T7]. For an elegant Z'^-proof {d < cxd), see [IB] , 

Since the shift Z'^-action on the d-dimcnsional full shift is always expansive, the 
function /i h{^) is upper semi- continuous for measures on any Tf^ subshift. It 
follows that the supremum on the right hand side is attained by at least one measure 
/Lt. For proofs and details see [1], for instance. 

A measure /i for which h{X) = h(fi) is called a measure of maximal entropy on 

X. 

We also need the notion of conditional entropy. For any finite F C Z"^, d € 
NU {oo}, any measure fi on the d-dimensional full shift, and any a-algebra A which 
is measurable with respect to fi, we define 

H,,{F \A):^-J log/i([.Tf] I A) dii{x), 

and correspondingly define the conditional entropy of fi with respect to A as 

h{^i\A) :=Jnn | 

A standard application of the definition of conditional entropy shows that we 
can also write 

where fi \ A denotes the conditional measure of /i given A. 

We will typically consider the case where A is the image of the underlying a- 
algebra for the measure space under a /i-measurable factor map tt; in this case, we 
will write the factor tt in lieu of A. 

The following two well-known results relate non-conditional and conditional en- 
tropies. 

Theorem. (Rokhlin-Abramov formula [23]) For any shift-invariant measure 
^ on alf^ subshift X {d £ N U {oo}), and any ^-measurable factor map tt on X , 

I tt) = /i(^() - h{n{fi)). 

Theorem 2.2. (See, for instance, p. 318 of [8]) For any c? G N U {cxd}, denote by 
Pd the lexicographic past of in TL'^ , i.e. the set of all g € Z'^ which have at least 
one nonzero coordinate, the first of which is negative. Then for any shift-invariant 
measure ^ on , /^(m) ~ ^tiii^} I ""Pd)- 

(Here and elsewhere, for a set S C Z'', tts represents the projection map x i-^ xs.) 

The proof of Lemma [2.21 in [8] formally applies only to the case d < oo, but a 
simple limiting argument yields the d = oo case. 

The above definitions and statements about entropy are all independent of the 
particular choice of F0lner sequence Fn. For general references on the entropy 
theory for amenable groups, see for example [T71 [T^] . 

We will naturally identify Z"*! as a subgroup of Z**^ whenever di < c?2 < oo 
via the embedding {vi, . . . , Vd^ ) >-> (wi, . . . , , 0, . . .), and say that a sequence of 
measures /i„ G P(S]^ ) converges in the weak-* topology to a measure fi in P(E^ ) 
if Mn([wF]) ^ m([wf]) for aU finite F C Z°° and aU wp G ■ 

The relevance of X'^°° to the problem of limiting entropy is manifested by the 
following lemmas: 
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Lemma 2.3. 

Proof. By definition, we have 

hoc{X) = lim h{X'^''). 

d^oo 

We have 

Thus, we can find an increasing sequence of integers (A'^i, N2, . . so that 
h^{X) = lim \ \C{X^'', [-N,,N,f)\. 

As is a F0lner sequence in Z°°, we also have 

= lim / hiV,,iV,]'^)|. 

Since C{X'^°° ,[~Nd, Nd]'^) = C{X'^'^,[~Nd, Nd]'^) by Lemma O it follows that 
h^{X) = h{X'^^). □ 

Lemma 2.4. Lei /ii, . . . , /^n, • ■ • be a sequence of measures where fin is a mea- 
sure on X^"^ . 

(1) If fJ-n ^ M weak-* topology, where fi is a measure on , then 
fi{X®°^) = 1. 

(2) //, in addition, every /i„ is a measure of maximal entropy of X^", then fi 
is a measure of maximal entropy of X®°° . 

Proof. To prove (1), choose any sequence which approaches a weak-* limit pi. 
Choose any finite F C Z°°. For some sufficiently large do, F C Z''", by definition 
of By Lemma [m C{X'^'^",F) = C{X'^'^,F) for ah do < < 00. Thus, for 
ah d > do, fid{xF e C{X^'\F)) = 1. It follows that fi{{xF £ C{X'^'^,F)}) = 1. 
Thus, 



( fl {xFeC{X^^,F)}\ =1, 



where the intersection is over all finite F C Z°°. This completes the proof of (1). 

Now, (2) follows by combining (1), the relation h{X^°°) = hoo{X) from Lemma [23 
and upper semi-continuity of measure-theoretic entropy. □ 

2.1. Multi-choice subshifts and independence entropy. We now recall some 
definitions and results from P2]. Let S denote the set of non-empty subsets of E. 
Let X be a Z'' subshift over E, where d G NU{cx)}. The multi-choice shift X C E^"* 
is the set 

X = {x e E^' : xc X}, 

where x G E^ is naturally interpreted as a subset of X , obtained by Cartesian 
products. 

The independence score of a configuration w 6 E^ with shape F is defined by 



^(-) = ^ E i°g 



F 

' neF 



We analogously define the independence score for x ^Yr by 

S{x) = limsup S'(5:|i?^). 

n— >oo 

Finally, we define the independence score of any shift-invariant measure /i on X as 

S{ji) = j S{x)djl{x). 

Observe that for any shift-invariant measure fi and finite F C Z'', S'(/i) ~ 
J S{xF)dfi{x). In particular, since x — ^ S{x) is a function which is invariant under 
shifts, it follows that for an ergodic measure /t, S{x) = S'(/i) /1-almost everywhere. 
Also, by the pointwise ergodic theorem, the limsup in the definition of S{x) is 
actually a limit /x-almost surely. 

Following |15| . we define the independence entropy hind{X) of a Z subshift X as 

h,^a{X) = lim (sup{5(?i) : w e C{X,Fr,)]) . 

See Section 4 of [15] for details on how existence of the limit follows from sub- 
additivity. 

The following lemma states convenient equivalent definitions of the independence 
entropy: 

Lemma 2.5. Let X be a Z,'^ subshift. The following are equivalent definitions of 
the independence entropy hind-' 

(1) /i,„d(X) =sup{5(x) : xeX}. 

(2) hind{X) is equal to sup^ ^(/i) where the supremum is over shift-invariant 
measures on X. 

Proof. Clearly, for any /i, S{pL) < sup{5'(a;) : x £ X}. Since x S{x) is a 
shift-invariant function, it is constant for any ergodic /i. In fact, for ergodic ^, 
S{x) = /x-almost surely. 

For any given e > 0, there are infinitely many n's and Wn G C{X,Fn) with 
S{w) > hind{X) — e. Since S{'w) is an average of S{w') for subwords w' of smaller 
length, we can assume w„ is a prefix of lin+i. By compactness of X, there is 
X € X with S{x) > hind{X) — e. It follows that the orbit closure of x supports an 
invariant measure with S{^) > hind{X) — e (see [6] for a classical presentation of 
this correspondence principle). 

□ 

2.2. Exchangeability and de Finetti's theorem. One of the main tools in the 
proof of Theorem II. II is de Finetti's Theorem, which we review here for complete- 
ness. 

Let P := i-'er77i(N) denote the group of finite permutations of the positive inte- 
gers, i.e. permutations of N which fix all but finitely many integers. P is a countable, 
amenable group. 

Definition 1. A sequence {Xn) of random variables is called exchangeable if 

for any n and n-tuples of distinct integers ii, 12, . . . , in and ji, j2, . . . , jn, the joint 
distributions of Xi-^ , ■ ■ ■ , Xi^ and Xj-^ , . • . , Xj^ are the same. Equivalently, [Xn) is 
exchangeable if all joint distributions are invariant under the action ofP on (Xn) 
by permutation of indices. 
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The simplest examples of exchangeable sequences of random variables are i.i.d. 
or Bernoulli sequences, which are clearly exchangeable. However, not every ex- 
changeable sequence is Bernoulli. For instance, one can define the Xi so that cither 
they must all be equal to (say with probability 0.3) or all must be equal to 1 
(say with probability 0.7). The reader may check that this sequence is exchange- 
able, but clearly it is not Bernoulli. However, it is a mixture of the two (trivial) 
Bernoulli sequences which are a.s. constant with value and a.s. constant with 
value 1 respectively. In fact, this is not an anomaly: de Finetti's theorem states 
that all exchangeable sequences are mixtures of i.i.d. distributions. 

Theorem (de Finetti's theorem). Any exchangeable sequence (y„) of random 
variables each taking values in a finite set Q is a mixture of identically distributed 
random variables. In other words, there is a measure 6 on the simplex of probability 
measures on CI such that 

P(r\i^k = a,} \ = I \{p{at.)de{p), 

\k=l I k=l 

for any ai, . . .a^ G fi. 

For our purposes, de Finetti's theorem for finite-valued exchangeable sequence 
is sufficient. We note that there is a stronger version, due to Hewitt and Savage 
f[10|). which applies to random variables taking values in a Borel measurable space. 

In particular, for exchangeable random variables, the exchangeable cr-algebra 
coincides with the tail cr-algebra: Any measurable function of an exchangeable 
sequence which is invariant under finite permutations of the variables is measurable 
with respect to the tail. In the case of exchangeable variables taking values in a finite 
set n, the particular i.i.d. distribution in the mixture can be recovered by observing 
the empirical distributions 'JI^{Xi, . . . ,X„, . . .) :— lim„_i.oo -^K* ^ n : Xi = a}|, 
a G O. 

2.3. Allowable local perturbations. A useful notion in the proof and statement 
of our results is the notion of "allowable local perturbations" for a point in a ifi 
subshift. 

For any subshift X dJ?' ,dgNU{oo}, shift-invariant measure on X, x G X, 
and g G Z'^, we say that a letter a is a fj,-allowable local perturbation of x at g if the 
conditional probability 

Px,gia) ■- ni{z G X : Zg = a} \ {z : Z{g}c = X[gy}) 

is greater than 0. 

For any shift-invariant measure /i on X, define a map iTf^ : X ^ by 

^p.i^)a = {a e S : Px,gia) > 0}. 

This is a measurable factor map to ; /i-almost surely, (TT^(x))g ^ for all 
g e , since by definition i-i{{xg G ^^^l,{x)g}) = f. 

3. Proof of theorem 11.11 

The group P acts on in a natural way by permuting coordinates: for p G P 
and g G Z°°, {p{g))^ := gp(i). Through the action of P on Z°°, P also acts on X®°° . 

We will consider measures of maximal entropy on X*^"" which are in addition 
invariant with respect to the action of P on The existence of such measures 
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follows from amenability of P, upper scmi-contimiity of measure-theoretic entropy, 
and the fact that the action of P on X'^°° preserves measure-theoretic entropy. 
To be specific, choose any shift-invariant measure v on X®°° , and take any weak- 

* limit point /i of the sequence po g{v), where the sum is over g G Fn and 

p G P„ , where P„ C P is the set of permutations which fix all integers greater than 
n. 

Clearly, h{i') ~ h{pv) for any permutation p e P. Since v i— > h{v) is an affine and 
upper semi-continuous function, it follows that /i is a measure of maximal entropy 
whenever v is a. measure of maximal entropy. 

Lemma 3.1. For any V -invariant measure v on X®°° and any finite F C Z°°\{0}, 
Xq and xf are conditionally v-independent given Xpc\^^Qy 

Proof. Define m = maxmaxjfc <E N : .9^ ^ 0}, and define t : Z°° — > Z°° by 

geF 

(51, (72, . . .) H> (0, (71, (72, . . .). It follows from P-invariance of v that 

Xp, Xr"^ F, XT2m p, . ■ . 

is an exchangeable sequence of random variables. For any a G S and sequence (C„) 
of elements of T,^ , define 

/a(Co,Ci,C2, ...):= v{xa = a\xF = Ci^,Xr--F = Ci,Xt-2™^ = C2, • • •)• 

fa is a function of Cq, Ci, . . . which is invariant under all finite permutations. 
It follows from de Finetti's theorem that it is measurable with respect to the 
tail cr-algebra. This proves that xq is conditionally independent from xp given 
{x^kmp : fc > 1}, and by our choice of m, t^™-F C F'^ for all k. 

□ 

Lemma 3.2. Let p he a measure on X®°° which is both shift- invariant and P- 
invariant. Then for a set of x E x®"^ of full fi-measure, any y £ obtained by 
a finite number of ^-allowable local-perturbations is in Also, for any such x, 

TTf^ix) G 

Proof. By compactness of X'^°°, it is sufficient to show that for /i-a.c. x G X'^°°, 
any finite F C and any configuration yp G with yg G ii^{x)g for all g G -F, 
there exists z G X®°° with zp = yp. 

It will suffice to show that for /x-a.e. x G X®°° and for any choices yg G TTfj.{x)g 
for aU geF, 

(1) ^l{{z G X®^ :zp = yp\ zp. = xp.}) = [] p^.g{yg). 

geF 

This is because integrating ([T|) with respect to /i shows that p{[yp]) > 0, and since 
p is a measure on X®°°, this would show that yp G C{X®°°), completing the proof 
as explained above. 

We prove ([T|) by induction on n = For n = 1. ([T|) is just the definition of 
Px,g- For the inductive step, assume that \F\ ~ n and that ^ is true for all sets of 
cardinality less than n. 

Choose some g G F, and let Fi := F \ {g}. For /i-a.e. x G the definition 

of conditional probability gives 

fi{{z G X®°° ■.zp^yp\ zp. = xp.}) = pl{{z G : zp, = yp, \ zpc = yF-,})Px,g{yg)- 
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The inductive hypothesis on Fi imphes that 

so showing ([1]) for F has been reduced to showing that Px.giVg) ~ Py,g{yg)- 

To see this, note that Lemma 13.11 imphes that yu-almost surely with respect to 
X, for any finite F C Z°° \ {g}, 

PxAVg) = e ■■Zg=yg\ Z{g}c = X{g}o}) = ^i{{z e ■.Zg = yg\ ZF^ = XFc}). 

In particular, 

PxAVg) ^PvAVg) 
since x and y are identical off the finite set _F, and we are done. 

□ 

In other words, for ^ as above, the measure-theoretic factor map tt^ maps to 

X®^^ /i-almost surely. We denote by jl the measure 7r^(/i) on X®^ . which is just 
the pushforward of ^ under tt^ . 

Our next step is to characterize the structure of P-invariant measures of maximal 
entropy on 

Lemma 3.3. For any V-invariant measure of maximal entropy ^ on X'^°°, 



(2) M = / Mi dfl{x), 

.Jx<s^ 

where for any x £ X®°° , fi^ denotes the independent product of the uniform mea- 
sures on Xg over all g G Z°° . 

Proof. The conditional entropy of fi given tt^ satisfies 

Hl^ I t^m) = / Hf,{{0} I 7r^,{x)) dfi < / log \xo\ dfi{x), 

jx»°° Jx»°° 

with equality holding in the second inequality iff the conditional distribution of xq 
under fi given 7r^(a:) is /i-a.s. uniform over the finite set 7r^(x)o. 

Thus, if yU does not satisfy the formula we could define a measure i' = 

/ fix djl{x) for which h{y) > h{ii). which would contradict the fact that /i is a 

Jx^ 

measure of maximal entropy. □ 

Lemma 3.4. Let pL be a P-invariant measure of maximal entropy on The 
measure-theoretic entropy of the measure fi with respect to the 1,°° -action by shifts 
is zero: 

h{fi) ^ 0. 

Proof. Suppose for a contradiction that h :~ h[fj) > 0. First, we note that by 
definition, for any g G Z°°, T:^{x)g is /i-a.s. uniquely determined by xs^gy as the set 
{a G S : Px,g[a) > 0}. But by Lemma [3.31 /i-a.s., 'n:^(x)g is independent of X{g|c 
given 7r^(a;){g-j.c . It is clear that if two random variables are independent and the 
first is a function of the second, then the first must be constant. Therefore, Ti^{x)g 
must be conditionally constant given 7r^(a;){g}c. In other words, /i-a.s., 7r^(a;)|g}c 
uniquely determines Tr^{x)g. 
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This means that there exists so that tt^{x)o is determined by 7r^(x) FAr\{o} with 
/^-probabihty 1 — (5, for (5 < jj^j^j^- Choose d large enough that < ft, + e, 

where e < ^ , . We now decompose Hfi{FN xFd) as a sum of conditional entropies: 



^M^^iv X Fa) = Hf^iiFN \ {0}) x Fa) + i/^({0} x Fa \ 7r(F„\{o})xFj 
< i\FN\-l)\Fa\{h + e) + \Fd\S\ogm 



\FN\\Fa\ 



h 



h 



51og|S| 



< \FN\\Fd\ 



h 



\Fn\ 
h h 



\Fn\ 



< \FN\\Fd\ 



h 



\Fn\ 



\Fn\ 



\FN\\Fd\h[ 1 



3|F, 



\Fn\ 3\Fn\ S\Fn\ 
From the general theory of entropy for amenable groups (as in |17j . p. 59), for any 
finite set P C Z°°, > h, and so we have a contradiction. 

□ 

Proof of Theorem \l.l\ Let /j, be a P-invariant measure of maximal entropy on X^°° . 
By Lemma tt^ is a measure-theoretic factor from the Z°°-system {X®°° , n) into 

(X®^,fi). 

The Rokhlin-Abramov formula gives 

h{^) = h{ij.) + h{fi I TTf,), 

where 



I TT^) 



1 



1™ T^-^'^(^" I '^'^(^)) 

is the relative entropy of fi over tt^. However, by Lemma [3.4[ h{p,) = 0. Since 
H^iF„\7T^ix))<S{Tr^{x)Fj, 

1 



(3) h^{X) = = hill I 7r„) < 

However, for any x G X"^"", 

1 



limsup ^-^.^(ii?^) dfl{x) 

\Fn\ 



limsup — — S'(iF„) < h,nd{X), 

n^oo \-^n\ 

SO hooiX) < hind{X). Finally, we already know from [THI 
so we have shown that hoo{X) = h^ndiX). 



that h„id{X) <hoo{X), 
□ 



4. Limiting measures of maximal entropy 

We now wish to discuss the structure of the measure(s) of maximal entropy /i on 
We will show that we can completely describe the structure of the measures 
of maximal entropy which are P-invariant. Denote by X®°°max C the set of 

points X with S{x) = hind{X). This is a shift-invariant and P-invariant subset of 

For any shift-invariant measure v supported on X®°°max, define a shift-invariant 
measure on X®°° by 

(4) $(t^) = / MS di'iS:), 
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where for any x G X'^°°„iax, fJ-s is the independent product of the uniform measures 
over Xg for g G Z°°. 

Theorem 4.1. For any ¥ -invariant measure of maximal entropy fi on X®°° , there 
exists a measure (a, supported on X®°°max such that fi ~ ^(p)- 

Proof. If /i is a P-invariant measure of maximal entropy for X'^°°, define /t = 7r,,(/i). 
Then, 

hooiX) = h^{{0} \7Tp^)= [ I 7:pjdiiix) = / \ ttp^ xtt^) dti{x) 

< / H^{{Q} I t:^) dii{x) < [ log Kp(x)o| dfi{x) ^ [ ^ S{xo) dfi{x) < h,nd{X)- 

The third equality holds sinee h{jl) = 0. By Theorem 11.11 hao{X) = hind(X). 
Therefore, all inequalities above are in faet equalities. The first inequality being 
an equality implies that xq is conditionally /x- independent from xp, given tt^{x). 
This clearly implies that /i-almost every fiber fix in the disintegration of fi over tt^ 
is a sitewise independent product. The second inequality being an equality implies 
that /Lt-a.s., the distribution of fix on a site g G is uniform over Xg. Finally, the 
third inequality being an equality implies that /i-a.s., S{x) = hind{X), and so /t is 
supported on X®°°max- 

□ 

Theorem 4.2. <I> is an injective map which sends shift-invariant measures sup- 
ported on X®°°max to measures of maximal entropy on X^°° . Also, $ preserves 
V-invariance of measures. 

Proof. Injectivity of $ follows from the easily checked fact that 7r$(^) o $(//) = fi 
for any measure fi supported on X'*°°max- 

For any such //, define /i :— Then = h{ii \ ii^) = / log jiol dfi{x), 

but since fi is supported on ^®°°max, / loglxol dfL{x) = h,^d{X®°°). Thus, 

h{n) = hind{X^°°), which is equal to by Theorem ll.il so /i is a measure 

of maximal entropy. 

If /t is P-invariant, and p G P, then 



fiop = 
so fi is P-invariant. 



/ Ms diy{px) = / ^ fix dv{x) = fjL, 



□ 



Theorems 14.11 and 14.21 show that there is a bijective correspondence between the 
P-invariant measures of maximal entropy on X®°° and the P-invariant measures 

supported on X®°°max- 

We now recall some technical facts, shown in |15j . about independence entropy 
for Z SFTs. It was shown in Theorem 2 from [H] that for any Z SFT X, there 
exists a word w G C{X, [1,to]) such that G X and = hind{X). Any such 
is called a maximizing cycle for X. A word w G 'C(X) is called a maximizing 
word for X if is a maximizing cycle for X. 
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For completeness, we give a self-contained proof of the following refinement of 
the above statement, which is essentially in |15) . 



Lemma 4.3. For any k-step Z-SFT X , X has a maximizing word w with no 
repeated k-letter subword. 

Proof. Consider a maximizing word w for X, and denote its length by m. li w 
has no repeated A-letter subword, we are done. Suppose then that w does have 
a repeated fc-letter subword, call it u. Let's say that W[i,i+fc-i] = ""^[jj+fc-i] = u, 
i < j. Define a = w^i j^i^ and b = W[j,Tn]''^[i.i_i] . We now claim that both a and 
b are also maximizing words for X. Note that every fc- letter subword of a°° was 
already a subword of , which is clearly in C{X) since w is. Similarly, every 

fc-letter subword of b°° was already a subword of t&ifc.miu^fi.i+fc-i] : which is in C{X) 
since w'^ is. Therefore, both a°° and 6°° are in X. 

Finally, we note that since each letter of w is contained in exactly one of a or b, 
S'(w) = hind{X) is a weighted average of S{a) and S(b). Both S{a) = S{a°°) and 
S{b) = S{b°°) are less than or equal to hind{X) by definition, so both are equal 
to hind{X), and therefore both a°° and b°° are maximizing cycles for X. Then 
a and b are maximizing words for X, and since each has length less than w, we 
can continue this procedure until we arrive at a maximizing word for X with no 
repeated fc-letter subwords. □ 

We say that a maximizing word for a fc-step Z SFT is simple if it has no repeated 
fc-letter subwords, and that a maximizing cycle is simple if it can be written as w°° 
for a simple maximizing word w. Now, for any simple maximizing word w, we 
will construct a specific finite orbit contained in X®°°,„ax- The method is simple: 
define xlw) G by x{w)g — w^g^ (mod \w\)- Then for any d,m and g S 

x(w)g+med = W52g,+Tn (mod and SO x{w)g+zea IS just a shift of the sequence 
w°°. Clearly, this implies that x{'w) S 5L®°°max- Denote by ©(w) the finite (P- 
invariant) orbit of x{w) under Z°°, and by flu, the uniform measure on 0{w). Then 
by Theorem 14. 2[ ^{fiw) is a P-invariant measure of maximal entropy on X^°°. 

Theorem 4.4. For any Z SFT X , there is a unique ¥-invariant measure of max- 
imal entropy on X^°° if and only if the following two conditions are satisfied: 

(1) X has a unique (up to shifts) simple maximizing cycle w 

(2) There is only one finite orbit of points in for which each row and each 
column is a shift of the sequence w^, namely the orbit of the periodic point w*-^-* 

(2) 

defined by w]J = Wi+j (mod |«>|)- 

Proof. (=►) If condition (1) is violated, then X has two simple maximizing cycles 
and w' which are not shifts of each other, which induce points x[w) and 
x{w') with different finite orbits 0{'w) and 0{w') contained in X®°°max- Then by 
injectivity of $, ^{fiw) and ^{fi—i) are distinct P-invariant measures of maximal 
entropy on 

If condition (1) is satisfied but condition (2) is violated, then X has a unique 
(up to shifts) simple maximizing cycle and a point w' in whose rows and 
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columns arc all shifts of w°° , but which is not a shift of w'^^K Wc now construct 
an uncountable family of shift-invariant and P-invariant measures supported on 
^®°°max, which by Theorem 14.21 will yield an uncountable family of P-invariant 
measures of maximal entropy on X^°°. First, for any a £ (0, 0.5), define rja to be 
the Bernoulli measure on {0, 1}'*' which gives probability a to and 1 — a to 1 at 
each site. Define v to be the uniform measure on {0, 1, . . . ,\w\ — 1}. Define a factor 
map T from {0, 1, ... , \w\ - l}^ x {0, 1}^^ to by 



TiiJ,iu„)){g) := w' \i+ ^ 5n, j + ^ 9n 

\ {n : Un—0} {n : u^ — 1} 

We first claim that t maps to X®°°inax- This is easy to check: by definition, 

for any i, j, and (u„), every row of T{i,j, (u„)) is just a row or column of w' , 
which will always be a shift of w^. Now, for any a g (0,0.5), define fia to be the 
push-forward oi v x v x r]a under r. Clearly each fia is a measure on ^®°°max- 
The reader may check that P-invariance of fia follows from the fact that r]a is i.i.d., 
and that shift-invariance of fia follows from the uniformity of v and the fact that 

^(2) 

w' is periodic with respect to (|w|,0) and (0, \w\). All that remains is to show 
that all /io, are distinct. For any a, define i>a to be the marginalization of to 
X {0}°°. It is clear that Va is always a finitely supported measure, which is a 

shift of w*^^' with probability a^ + {l~a)'^, a shift of w' with probability a(l — a), 

-^(2) ^(2) -^(2) 

and a shift of w' with probability a{l ~ a), where w' is obtained from w' by 
permuting the first and second coordinates. But then since w^^-* is different from 

. .(2) - .(2) 

both w' and w' and since -I- (1 — a)^ is injective on (0, 0.5), clearly all i^a are 
distinct, implying that all fia are distinct, and therefore that all $(/^ct) are distinct 
P-invariant measures of maximal entropy on X'^°° . 

(<^=) If conditions (1) and (2) are satisfied, then we will show that any shift- 
invariant measure supported on X®°°niax is in fact supported on 0{w). Clearly the 
only such measure is fiu,, and Theorem 14.11 then implies that the only P-invariant 
measure of maximal entropy on is $(/i^,). 

Suppose that /i is a shift-invariant measure on X®°°inax, and choose any d £ N. 
Then 5(/i) = / S{xz,ed) dji{x) = h^nd{X), so clearly S'(xzeJ = hind{X) 

//-almost surely. Choose k so that X is a fc-step SFT, and consider any ii which 
contains no repeated fc-letter word and for which u°° G X is not a shift of w°°. 
Since w°° was the unique (up to shifts) simple maximizing cycle for X, S{u) < 
hind{X). If pi{[u]) > 0, then for /t-a.e. x £ X, u occurs within x^ea with positive 
frequency. Denote by v the fc-letter prefix of u. Then we can decompose any xzcd 
as . . . vu-ivuqvuiv . . ., where vut = u for a set of integers i of positive density. 
Then, since {vui)°° G X for every i, the same argument from Lemma 14.31 shows 
that S{vui) < hind{X) for all i, and so S{xj^ed) < hind{X), a contradiction. So, 
/<([m]) = 0. Clearly, this shows that /i-a.s., xze^ is just a shift of By shift- 

invariance, for /i-a.e. x G it is also the case that for any g G Z°° and d e N, 



is also a shift of ?i° 
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Consider any such x, where every row in every direction is a shift of w°°. Then 
for any dimensions di < 6,2 and any g G consider the infinite two-dimensional 
configuration ig+ze^j+Zed^ • Each row and column of Xg+ze^j +Zed2 ^ shift of w°° . 
But then by condition (2), Xgj^ze^^+zed^ is a shift of w'-^^ and so is periodic with 
respect to e^i — ed2- Since this is true for all di, d2, and g, x must be periodic with 
respect to e^i — e^^ for all di < c?2- This implies in turn that x is periodic with 
respect to any g S Z°° with ^gi = ^- It is simple to check that any point in & 
which is periodic with respect to all such vectors and whose marginalization to Zei 
is a shift of must be a shift of x{w). 

We have then shown that any shift-invariant measure ji on X'*°°max is supported 
on 0{x{'w))^ which implies that is the unique P-invariant measure of maximal 

entropy on as explained above. 

□ 

The techniques of Theorem 14.41 also allow us to give one more case in which the 
set of P-invariant measures of maximal entropy can be completely described. 

Theorem 4.5. If X is a Z SFT such that X has k different (up to shifts) simple 
maximizing cycles w}, 1 < i < k, and if no two wl share a common letter of S, and 
if for each i G [1,^:], there is only one finite orbit of points in for which each 
row and each column is a shift of the sequence wf' , then there are exactly k ergodic 
-invariant measures of maximal entropy on X®°° . 

Proof. We will only sketch a proof, as the details are almost the same as in the 
proof of Theorem 14.41 Firstly, by the same reasoning used there, for any ergodic 
P-invariant measure of maximal entropy /i on X®°° and for any g G Z°° and d G N, 
it is fi-a.s. the case that Xg+zed is a shift of one of the simple maximizing cycles 
Wi°° . But then since no two wl share a common letter, this i must be the same 
for all g and d, and by ergodicity, it is fi-a.s. constant. So, there exists i for which 
/t-a.s., for any g G Z°° and d G N, Xg+Ze^ is a shift of Wi°° . 

Then a similar argument as was used above shows that /t must be supported on 
0{x{'Wi)), and so ^ = ^{ft^). Since there are only k possible choices for i, and 
each clearly gives a different measure, we are done. 

□ 

5. Applications to specific models 

The purpose of this section is present some applications of our general results to 
various specific models which have appeared in the litrature. 

5.1. Hard-square model. The underlying Z subshift, also known as the golden 
mean shift, is 

n:={xe{0,lf ■■ a;„x„+i^ll}. 
The d-dimensional hard-square model is then defined as 'H'^'^. 

It is easily checked that /loo('H) = hind{H) = ^log(2). As shown in [T5], the 
results of Galvin and Kahn [7] can be used to show that /loo('H) at an 

exponential rate, with explicit numerical bounds. In this case, it is easily checked 
that (0{0, 1})°° is the unique (up to shifts) simple maximizing cycle for "H, and 
so Theorem 14.41 implies that there is a unique P-invariant measure of maximal 
entropy on 'H®"". In fact by [7], uniqueness holds even without the assumption of 
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P-invariancc. The unique measure of maximal entropy is not weak mixing; since 
fi-a..s. each point of 'H'^°° either has Os on all odd sites or Os on all even sites (the 
parity of u £ Z°° is just the parity of the sum of its coordinates), and fi-a.a. only 
one of these can hold, clearly fi has an eigenfunetion with eigenvalue of —1. The 
combinatorial methods of Galvin and Kahn show that this eigenvalue is also present 
in the (unique) measure of maximal entropy on 7^®^ for all sufficiently large d. 

5.2. n-coloring shifts. The one-dimensional n-coloring shift is 

Cn --^ {X e {1,. . . ,n}'^ : Xn^Xn+l}- 

The d-dimensional n-coloring shift is defined as C®''. 

By our results, h^{Cn) = hmdiCn) = \\og{\n/2\) + ilog([n/2]). There are 
([n/2j) (^P ^'^ shifts) simple maximizing cycles for C„, namely all sequences {ab)°° 
for which a and h form a partition of E and \a\ = L^J • Since no two of these cycles 
share a common letter, by Theorem 14 . 51 there are exactly (^„"2j) ergodic P-invariant 
measures of maximal entropy on /i(C®°°), each of which has eigenvalue —1 as in 
the hard-square model. 

The case n = 3 is of particular interest, since 3-colorings have useful connections 
to the well known "square-ice" model for d = 2 [13]. In [T5|, it was shown that 
h{Cf'^) — > hooiCs) = ^ exponentially fast. The argument involved creating a 
correspondence between configurations in the c?-dimensional hard-square and 3- 
coloring shifts, and then exploiting the previously mentioned results of Galvin and 
Kahn. From a recent paper of Peled [201, it follows that for sufficiently large d 
there are exactly 3 measures of maximal entropy (even without the assumption of 
P-invariance), each of which admits an eigenfunetion with eigenvalue —1, just as in 
the hard-square case. 

5.3. Beach model. In 2 . Burton and Steif defined the d-dimensional beach model, 
for any M > 0, to be the nearest-neighbor Z'^ SFT on the alphabet {— M, . . . , —1, 
f , . . . , M} defined by the restriction that adjacent letters must have product greater 
than or equal to —1. In other words, a negative and positive cannot be adjacent in 
any cardinal direction unless they are 1 and —1. These are clearly all axial powers 
of the one-dimensional beach model, which we denote by Bm- 

It is easy to show that hind{BM) = \ogAI, and that for AI > 2, there are exactly 
two simple maximizing cycles for Bm, namely {—A/, . . . , —1}°° and {!,..., M}°°. 
(When M = 1, Bm is just the full shift on two symbols, and when M = 2, there is 
an additional maximizing cycle { — 1,1}°°. We will not address these special cases 
further here.) Therefore, our results show that h{Bff) logAf, and that Bfj^ 
has exactly two ergodic P-invariant measures of maximal entropy. 

In fact, it was also shown in [5] that for any fixed d and for M > 4628"^, Bff 
has exactly two ergodic measures of maximal entropy. Our result would seem to 
suggest that the same is true for fixed M and sufficiently large d, and in fact this 
was stated as a conjecture in [3]. 

The beach model was further studied in [5], where it was extended to a more 
general class of models, with a real-valued parameter M replacing the previous 
integer-valued parameter. Disagreement percolation techniques were used to show 
that for any fixed d and M < 2%Xd-i ' d-dimensional beach model has a unique 
measure of maximal entropy. Unfortunately, this only applies to values of M less 
than 2, and so never applies to the classical beach model. 
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5.4. Run length limited shifts. For any < d < k < oo, the (d, k) run-length 
limited shift, also denoted by RLL{d, k), is the SFT on the alphabet {0, 1} consisting 
of all sequences in which all maximal "runs" of Os have length inside the interval 
[d,k]. For instance, RLL{0, (x) is the full shift on two symbols, and RLL{l,oo) is 
the usual golden mean shift. For any < d < k < oo, it was shown in |21j that 

fuTTf^uw L(fc-rf)/(d+l)J In 2 
h^URLLid, k)) ^ and 

ht„diRLL{d, oo)) = 



d+1 

It was shown in [T5], using combinatorial methods, that for any d, h{RLL{d, 00)^"^) — > 
hind{RLL(d, 00)), and that the rate is exponential. Our results show that this same 
convergence is true for any d and k (but say nothing about the rate.) 

It is relatively simple to check that there is a unique (up to shifts) simple maxi- 
mizing cycle for any d and k. (This was essentially done, without using our termi- 
nology, in [21| . ) These cycles are given by the maximizing words 

w = 0'^{0, 1} for RLL{d, 00) and 

w = odi{Q'^{Q^l])y^^-d)/id+^)\ for RLL{d,k). 

All of these unique maximizing cycles are symmetric, meaning that {w\^\W\yj\_i . . .wi] 
is just a shift of w°° . Therefore, for any RLL{d,k), we can construct a point 

-^(2) (2) 

w' defined by w'^^ ~ ''^i-j (mod |tu|)i in which all rows and columns are shifts 
of 1!)°°. In all cases except RLL{1, 00) and RLL{0,1) (for which the associated 
simple maximizing words have length 2) and RLL{0, 00) (for which the associ- 

ated simple maximizing word has length 1), w' is not equal to the point w*-^-* 
from Lemma 14. 4[ and so if X is any run-length limited shift except RLL{l,oo), 
RLL{0, 1), or RLL{0,oo), then X^°° has multiple P-invariant measures of maxi- 
mal entropy. For each of these three special cases, X^°° has a unique P-invariant 
measure of maximal entropy, which we already knew, as these are simply the golden 
mean shift, the golden mean shift with digits and 1 reversed, and the full shift on 
two symbols, respectively. 

5.5. Even shift. The even shift is the sofic shift £ on the alphabet {0, 1} consisting 
of all sequences in which all maximal "runs" of Os have even length. It is easy to 
show that hind{£) = 0; in fact, S = {{0}, {1}, {0, 1}}, and it is not hard to check 
that the maximum number of times the symbol {0, 1} can appear in a point of £ 
is two. So, our results imply that hoa{£) = 0. 

Finding hoo{£) was of particular interest for two reasons. Firstly, in |14| . a 
combinatorial argument was used to show that for the similarly defined odd shift 
O, h{0®'^) = \ for aU d. Secondly, it was shown in [15] that hry^{X) = for any Z 
SFT X with zero independence entropy, and it was naturally wondered if the same 
was true for sofic shifts. 

5.6. Dyck shift. This non-sofic subshift V C ({ai, . . . ,aA/} U . . . ,/3m})^ is 
obtained by considering the alphabet letters as M "types" of "brackets." The 
constraints are that matching open and closed brackets must be of the same "type," 
which in our terminology means the same subscript. This interesting non-sofic 
shift originated in the study of formal languages. It was introduced into symbolic 
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dynamics in [T^], where it was shown that h{'D) — log(A/ + 1) and that there are 
exactly 2 ergodic measures of maximal entropy. 

It is easily shown that hindi'D) = log A/, and that there are precisely two (up to 
shifts) simple maximizing cycles on P, namely {ai, . . . , and . . . , Pm}°° ■ 

Thus /loo (2^) = logAf, and since these cycles contain no common letter, Theo- 
rem l4.5l shows that there arc precisely two ergodic P-invariant measures of maximal 
entropy on V®°° . 

5.7. Symmetric nearest-neighbor SFTs. In recent work of Engbers and Galvin 
[5], they study, for any finite undirected graph H, the limiting behavior of the 
distribution of uniformly chosen graph homomorphisms from discrete d-dimensional 
TO-tori Zf,j = {1, . . . , jTi}'' to H as d — > oo. Recall that a graph homomorphism from 
Gi ~ iyi,Ei) to G2 = (V^2,£^2) is a function a: : Vi — > V2 such that {x{v),x{w)) 
is an edge in E2 whenever {v^w) £ Ei. In particular, for a fixed finite undirected 
graph G = (V, E) , the collection of graph homomorphisms from Z'' to G is precisely 
the nearest-neighbor SFT Xq C V'^ defined by enforcing (a;„ , Xn+et ) £ i? for all 
n aT!^ and ?' = 1 . . . d, which is a d-dimcnsional axial power of a symmetric nearest- 
neighbor SFT. 

The authors prove that for any fixed m and undirected finite graph H = (V, E), 
with probability tending to 1 as — > cio, a uniformly chosen random graph homo- 
morphism X from Zf„ to H has corresponding disjoint A, i? C V which induce a 
complete bipartite graph, with |^||-B| maximal, such that Xn £ A for a large pro- 
portion of even vertices n £ ZJ^ and x„i G B for a large proportion of odd vertices 
mGZi. 

These results are related to ours in that they provide an alternative proof for 
some of our results for the particular case of symmetric nearest-neighbor SFTs. 
Observe that for any symmetric nearest-neighbor SFT X C T,^, there is always a 
simple maximizing word in X of length 2, and that any such word corresponds to 
a maximal induced complete bipartite graph of H. 

However, the methods of Engbers and Galvin are apparently very different then 
ours, and in particular give additional finitistic results. 

6. Further Problems and research directions 

Here we summarize a few possible directions for extensions or generalizations of 
our results. 

6.1. Pressure and equilibrium measures. In statistical mechanics, it is com- 
mon to introduce a "potential" or "activity function," in which case the role of 
topological entropy is replaced by topological pressure, and measures of maximal 
entropy are generalized to equilibrium measures. From the ergodic-theoretic point 
of view, many results generalize without difficulty (see, for example, [22j for a 
statement and proof of the variational principle for pressure) . 

In [7] and in [5], for some specific Z subshifts, an analysis of equilibrium measures 
was carried out with respect to a single-site potential on X'^'^ as d 00. 

It is rather easy to generalize the statements and proofs of our results to the 
setting where entropy is replaced by pressure with respect to a so-called "single-site 
potential" / : X — > R, given by /(x) = F{xo) for some function : S — R. From 
the statistical mechanics viewpoint, / doesn't involve any "interactions" between 
sites. 
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Here is a brief formulation of the analogous result: For w e C{X,F), define 
Sf{w) = X! X! Define Pind{X,f ) analogously to h^nd{X), with 5/ 

replacing and 

Poo(X,/)= hm 

a— >oo 

where /'^''^ : X®'^ — M is again given by f{x) — F{xq). 

By following our proof of Theorem 11.11 one can deduce that Pind{X,f) = 

It is more difficult to generalize to interactions involving multiple sites, even to 
the case where / depends only on the letters at the pair of adjacent sites xq and 
xi. We believe a version of our result to be true for any interaction / which is 
finite-range (meaning that / depends only on the letters at finitely many sites) , but 
it is not completely clear what the proper hypotheses would be, and in particular 
what a "natural" definition of /'^'^^ would be in this case. 

6.2. Finitistic results. Our techniques involve studying the system which 
is a sort of "infinite-dimensional" axial power of X. It is natural to wonder what 
information we can glean about the finite-dimensional axial powers X®"^. For in- 
stance, we have shown that h{X'^'^) — >■ hind{X), but with no information about the 
rate. This is a question of particular interest, since it was noted in |15| that for all 
examples where the rate of convergence is known, this rate is exponential. 

Another example of useful finite-dimensional information regards measures of 
maximal entropy. As described in Section [5j our results allow us to count the 
P-invariant measures of maximal entropy on X'^°° for many models, such as the 
hard-square model and n-coloring shift. It is natural to assume that such results 
should allow us to draw conclusions about the number of P-invariant measures of 
maximal entropy on X®"* for large enough d, but we have not yet been able to do 
so. 

One reason why we believe such finitistic results should be provable is that one 
of the keys to our proofs, dc Finetti's Theorem, has versions which apply to finite 
sets of exchangeable random variables. ([4]) We hope to use these finite versions to 
answer some finitistic questions in future work. 

One specific case in which exponential convergence of h{X'^'^) to hind{X) has 
been proven is in the case where X is an SFT and hind{X) = 0. ([IS]) Interestingly, 
in the case where X is nearest neighbor, this convergence is trivial. 

Lemma 6.1. For any nearest-neighbor Z SFT X with zero independence entropy, 
h{X'»^)=0. 

Proof. Let X C be a n.n. SFT with zero independence entropy. We can restrict 
to the non- wandering part of X, which is a disjoint union of irreducible subshifts 
of finite type, thus we may assume X is irreducible without loss of generality. 

First we show that for any a, 6 G S, there is at most one c G S such that acb £ 
C{X). If this were not the case, there would exist distinct ci,C2 £ S with acib £ 
C{X) for i = 1, 2, and then for some di, . . . , dk £ S, {a}{ci, C2}{&}{di} • ■ • {rffc}{a} 
would be in C{X), which would yield a point ({a}{ci, C2}{6}{rfi} • • • {rffe})°° with 
positive independence score, contradicting hind{X) = 0. 
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Next we claim that for any finite F C "Z, and any c G S there is at most one 
X'^^-admissible configuration d £ j^^F'^OF dgp = c; this is done by induction 
on 

The base case of the induction is |F| = 1; say F ~ {{n,m)}. Then {n — 
1, m), {n, m + 1) G dF. Let a — C(^n-i.m) ^-nd b = C(„ „i_|_i): it follows that there is 
at most one c for which acb € 'C(X). Since X is nearest neighbor, this means that 
there is at most one c for which ac and cb are both X-admissible. Thus, d(^n,m)C is 
the only X®^-admissible filling. 

For the inductive step, choose {n,m) G F so that {n — l,m), (n, m + 1) 6 dF. 
(For instance, take {n,m) to be the greatest element of F lexicographically.) By 
the same argument, there is at most one letter d(^n,m) which can fill (n, in) in a 
X^^-admissible way given C(„_i „j) and C(„ Now the induction hypothesis 

on \ {(??,, m)} implies that there is at most one X'^^-admissible filling of F U dF 
given c and d(„,m). 

This implies that \C{X®^ , < for any n, and so that h{X®^) = 

0. 

□ 

For subshifts of finite type which are not nearest-neighbor, there is no finite d 
for which zero independence entropy implies h{X®'^) = 0; it was demonstrated in 
[n] that h{RLL{n, fc)®'') = iS k = n + 1, yet h,nd{RLL{n, A:)) = if fc < 2?!. 
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